Methods for generating image set or series with imperceptibly different images, systems therefor and applications thereof

ABSTRACT

A method for generating a series of images for playback on at least a portion of a display, each image in the series being imperceptibly different from an immediate preceding different image in the series, methods for displaying such images, systems for generating and/or displaying the images and media carrying such images. The images are generated such that each subsequent different image in the image series is different from a prior image by an image difference determined prior to generation of the subsequent corresponding portion of an image. The image series is displayed with such timing that an ordinary viewer cannot perceive the transitions or differences between adjacent or successive images over at least a 5 second interval, yet over time, the displayed scene will progress so that at widely disparate points in time, the displayed images can be perceptibly different, i.e., the scene can be noticeably different.

PRIORITY APPLICATION DATA

This application claims priority CIP of application Ser. No. 09/538,137filed Mar. 29, 2000 now U.S. Pat. No. 6,433,839. The foregoingapplication is incorporated herein for all purposes to the extentpermitted by law.

BACKGROUND OF THE INVENTION

The invention relates to methods for generating and manipulating images,i.e., image processors, as well as products and the like either carryingthe images and/or the coding therefor.

Examples of previously known systems and/or methods for generatingimages that transition from one to another are screen savers forcomputers, programs for generating so-called morphed images, etc.However, all of these systems/methods generate images in a sequence thatare perceptibly different from one another, i.e., they generate imagesfor the purpose of effecting a discernable transition over a relativelyshort period of time. The result is that two given sequential images areperceptibly different from each other. Thus, an ordinary human observercan perceive a difference between successive images or frames in theseries.

At least one problem associated with the playback of a sequence ofimages with perceptible differences therebetween, is that the motionand/or flicker and flashing created by the transitions between imagescan be quite annoying, if not distracting. Many can relate to beingdistracted by the flashes caused by a nearby television, or simplynearby motion. Some might respond by redirecting their attention to thetelevision or motion, even if only temporarily, due to the naturalresponse to want to acquire information about the motion. Others mightbecome agitated because of the constant bombardment of light signals onthat person's senses.

Relative to the use of the invention in image display, there are someissues worthy of consideration regarding electronic display devices. Adisplay, such as a flat panel display, when mounted on a wall or thelike, and when not in use, can present an invasive black space that cancontrast with other aesthetic considerations such as art work locatednearby or displaced by the display. Cathode ray tube devices, incontrast, have frequently been hidden within cabinets, but as theyincrease in size, they consume more space and become more difficult toconceal.

SUMMARY OF THE INVENTION

The invention provides methods/systems for producing images along atransition path (defined below) wherein sequential different images areimperceptibly different (defined below) from each other, media/devicescarrying such images, and methods/systems employing such images. Theresult is the display of a series or set of images in such a way that anordinary viewer will not perceive the transitions between differentimages, or motion caused by such transitions, except over relativelywidely disparate points of time, and thus not be subject to thedistractions/annoyance caused by changes in a display.

In one aspect, the resultant display of such an image series or set is a“still” image that evolves unnoticeably over time, and perhaps even atype of art form. This then provides an image display that can allow adisplay to display images without introducing distraction. Further, sucha display can present an aesthetic enhancement as an artistic outlet.

In an embodiment, the invention provides a method for generating imagesin which a series or set of transition images are generated along atransition path from a first image to a second image. The transitionimages are generated such that a given transition image is imperceptiblydifferent from an immediately preceding image.

In an embodiment, the transition images are then displayed in sequenceover a period of time sufficiently long so that a change in display fromone image to a succeeding different image cannot be perceived by anordinary human observer, yet over time, the display transitions from thefirst image to the second image.

In this application, for convenience, several definitions have beenadopted and apply throughout. These definitions are as follows:

Transition path: a series or set of images representing a progression,an evolution or changes from a first image to a second image, in steps.Typically the progression will be rational, for example linear,exponential, etc, or otherwise reproducible. However, it is alsocontemplated that the progression can be random, and not reproducible.Further, typically, a series or set of images along the progression willbe displayed chronologically, although other displays such as spatiallydisplaced images, are contemplated. In the latter instance, a series oftransition images can be displayed simultaneously but along some spatialcontinuum.

A series or set of images incorporating a transition path need not allbe different, and indeed in at least one aspect of the invention, aseries of images is provided in which each different image is providedas a set comprising a plurality of copies of the same image. This aspectis the result of current applications in which a series of imagesessentially comprises a movie upon playback, and current movie playbacksystems require that a plurality of copies of a given image be displayedin seriatim in order to achieve an effective slower timing betweentransitions between different images.

Further, a set of images can be formed which are imperceptiblydifferent, yet which are not played back in the order generated. If thedifferences are sufficiently small, then some images may be displayedout of order of generation without being noticed.

The foregoing matters will become clearer below.

Transition image: an image along a transition path incorporating animage difference relative to a preceding image. The “second image”referred to in the definition of “transition path” can be a transitionimage, and typically is the last transition image along the transitionpath.

Image difference: any difference between two images, includingdifferences in hue, brightness, saturation, color space component orangle of view, whether on a pixel level, subpixel level or block ofpixels level.

Imperceptible image difference, images that are imperceptibly different,and the like: an image difference that cannot be perceived by anordinary human observer. It is accepted that generally, an ordinaryhuman observer cannot perceive a change of 20 percent or less in anysingle component of a color space. For example, an ordinary humanobserver typically cannot perceive a 20 percent change in any one ofhue, luminance, saturation and a color component, such as cyan, magenta,yellow, red, or green. It has also been stated that an ordinary humanobserver cannot perceive a difference in motion below about 0.03 of adegree of the visual angle per second. A change in view of 5 seconds ofarc of view or greater has also been deemed perceptible. Finally it hasbeen stated that the threshold for the human eye is a function of theapparent angular size and brightness of the scene. In optimum conditionsand spots greater than about 10 arc-minutes the contrast is as low as0.3%, rising to about 1.0% at about 5 arc-minutes, 15% at about 1.0arc-minute and about 30% at the smallest resolvable detail at about 0.7arc-minute with normal eyesight. See Blackwell, H. R., ContrastThresholds Of The Human Eye, J. Optical Society of America, Vol. 36, pp.624-43 (1946).

In displaying images along a transition path, in which a given image isimperceptibly different from an immediately preceding different image,timing of the transition is also a consideration in maintainingimperceptibility. That is to say, presumably one could transition sofast through the series of images, that the transitions and/or motiondisplayed by such transitions would be noticeable, even though thedifference between any two images in the series would be imperceptible.Accordingly, to transition imperceptibly through the different images,the timing of the display of each different image should be on the orderof 5 seconds or more. Obviously, the longer the display period there isless chance for perception of the differences.

Accordingly, an aspect of the invention is a resultant display of imagesthat appear as a still image, but which in reality progress through asequence to provide an evolution in character and/or scene withoutperceptible motion or transitioning.

In an embodiment, of the invention, to generate a transition path, firstand second images are compared, and then an imperceptibly differenttransition image is generated as an incremental change from the firstimage to the second image.

In an embodiment, the first and second images are processed in a digitalformat and are compared pixel by pixel, and a corresponding pixel isgenerated in a transition image that is twenty steps (pixel values)closer or less to the value of the corresponding pixel of the secondimage from value of the corresponding pixel of the first image.

These and other features and/or aspects of the invention are describedbelow in the following detailed description of the presently preferredembodiments with reference to the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates in schematic form a series of transition images.

FIG. 2 illustrates in schematic form a specific generation of transitionimages.

FIG. 3 illustrates the beginning and end points of a transition pathrelative to a change in spatial displacement along a larger image.

FIG. 4 illustrates an image useful for explaining relative motionbetween objects in an image.

FIG. 5 illustrates in schematic form a system for generating images inaccordance with principles of the invention.

FIG. 6 illustrates a system for displaying images generated inaccordance with principles of the invention.

FIG. 7 illustrates another system for displaying images generated inaccordance with principles of the invention.

FIG. 8 illustrates in flow chart form a basic method for generatingimages in accordance with principles of the invention.

FIG. 9 illustrates in flow chart form another basic method forgenerating images in accordance with principles of the invention.

FIG. 10 illustrates a method of using the present invention in a medicaltesting application.

FIG. 11 illustrates in schematic form a variety of displayconfigurations for displaying images generated in accordance withprinciples of the invention.

DETAILED DESCRIPTION OF THE PRESENTLY PREFERRED EMBODIMENTS

Presently, it is envisioned that a set or series of images can begenerated and stored for playback in such a manner that, to the eyes ofthe ordinary human observer, a display imperceptibly progresses orevolves through the images. For example, over a sufficiently long periodof time, a display can progress or evolve from a first image to a secondimage which is identical in scene, but with a color space change. Thiscolor space change could simply be a change in value of a particularcolor component or other characteristic, such as brightness. Between thetwo images is a series of transition images with progressive color spacechanges the stepping through of which cannot be detected by theobserver.

The images can comprise an entire displayed scene or one or moreportions thereof. At least within the portions of a scene to which theimages pertain, the image series can be considered a series of frames.

This concept involves more than merely slowing down the transitionsgenerated by a typical image morphing program. Instead, the individualimages along the transition path are generated so as to be imperceptiblydifferent from an immediately preceding different image, i.e., thedifference between successive different images is kept to within theparameters defined above, e.g., a color space component change of 20percent or less, or a change in angle of view of 5 seconds of arc, etc.Thus, it can be understood that generally, an image manipulation programsuch as a so-called morphing program can be used to generate imageswhich are then used as the beginning and ending images of a transitionpath.

Various color spaces are known, and can be considered for characterizingan image or portion thereof. Some known color spaces are: RGB, CMY, YIQ,HSV and HLS. These are well known and discussed, e.g., on the worldwideweb at http://cs.fit.cdul˜wds/classes/cse5255/davis/text.htm/#RGB, andincorporated herein by reference. A printout is provided along with theapplication. Another color space listing, also incorporated herein byreference, is available at http://www.cgsd.com/colorspaces.html, aprintout of which is provided herewith.

It is conceivable that through use of very high speed motion photographyof a scene with very low motion, and subsequent very slow playback, asimilar effect can be achieved. However, the present invention isdifferent in that it concerns image processing to achieve the endresult, and through image processing can provide many features notavailable with a film-based process. That is to say, in accordance withthe present invention, transition images are generated from one or moreprovided images. In contrast, in high speed photography, a series oforiginal images are generated, and they are not subsequently processedto generate transition images.

To be sure, as discussed below, the resultant transition images could bestored on film and played back using film projection techniques. Thus,for example, the individual frames of a high speed remote could be usedas the boundaries for a series of transition paths. The playback of theenter series of transition paths would result in a slowing down of thefilm or playback and in more gradual transition between frames.

In accordance with one aspect of the invention, to produce a transitionpath, an initial image, which itself can be a first image along atransition path, or a transition image along the path, is compared to asecond image, which can be a transition image, and differences arenoted. Typically, the first and second images will be the initial andfinal images along the path. In any event, the noted differences canvary depending on the parameters selected. For examples, differences inpixel values for digital images, differences in one or more color spacecomponents, differences in angle of view, differences in spatialpositioning of objects, etc. may be noted. Then a transition image alongthe transition path between the first and second images is generated,the transition image being an imperceptible evolution from the firstimage to the second image.

It can be appreciated that the greater the dissimilarity between thefirst and second images, the greater the number of transition imagesneeded to created an imperceptible progression between them. This isbecause there will a greater number of different attributes that need betaken into consideration in calculating changes to create the transitionimages, as well as a greater range of values to progress through.

As is known, pixels on typical hardware configurations are capable ofassuming values between 0 and 255 in terms of luminance. This includesthe sub pixels corresponding to the different color channels in a colormonitor. The particular combination of luminosity values assumed by thepixels and/or subpixels determines color, contrast, sharpness, etc.Thus, there are 256 linear steps or increments possible between the endsof the range. A twenty percent difference along such a range is on theorder of 50 steps.

In a presently preferred simple routine for accomplishing the foregoingtransition image sequence creation, the two images are compared, channelby channel, pixel by pixel, and a transition image is generated in whichthe pixel values include a 20 step progression or less (i.e., less than10 percent change) from the value of the corresponding pixel in thefirst image toward the value of the corresponding pixel in the secondimage. The progression is limited to the final value so that at somepoint, the last transition image and the second image are the same.

Of course, if the pixels of a display can assume a greater or lesserrange, such a 32 bit range or a 4 bit range, then the number of stepsmay be greater or lesser, respectively. However, it is believed that thepercentage change factor for perceptibility remains the same.

Given a series of transition images making up the transition path, theimages can be played back or displayed with a timing that produces a“movie” of an evolution from the first image to the second image inwhich the transitions between the images cannot be perceived by theordinary human observer. To be sure, the observer would note that thedisplay appears different at two sufficiently disparate points in time.

Additionally, given a suitable system, such a transition path can begenerated in real time and broadcast so that the “movie” is displayed inreal time. A display system would then be programmed and/or tuned to thebroadcast signal so as to receive and display the images as they arebroadcast, or to receive and store the images for subsequent broadcast.

To be sure, if the first and second images are widely dissimilar, alongthe transition path there may be unrecognizable images. Moreover, themore dissimilar the first and second images, the greater the number oftransition images are needed to created an imperceptible progressionbetween them. Accordingly, in the case where a transition path betweentwo selected images is desired, it is likely better to use two similarimages. This preference applies mostly to recognizable images such asclassical paintings and the like.

Finally, it can be appreciated that the methods described herein can beperformed manually or automatically. That is to say, by way of exampleonly, to generate a transition image, one can manually compare differentpixel values and then manually manipulate pixel values using knowncomputer software. To be sure, to manually produce transition images maybe a tedious process. Alternatively, an algorithm can be written toeffect either or both the comparison function and the image generationfunction.

In producing transition images manually, one can use any of a variety ofimage manipulation applications available on the market such as thefollowing: Adobe PhotoShop and After Effects™; Blue Ice—Ice'd AfterEffects Ultra™; Video Toaster™; Media 100™; and Lightwave VT™, to name afew.

To illustrate more clearly the concepts involved in this invention,reference will now be made to the drawings.

In FIG. 1 there is illustrated a series of images along a transitionpath. The series starts with a first image I1 and ends with a finalimage I2. In between image I1 and image I2, are transition images IT1,IT2, . . . , ITn. Image I1 might be a white flower and image I2 might bethe same flower, but colored red. Alternatively, Image I1 might be theupper left corner of an M. C. Escher illustration (for example “Day andNight”), and Image I2 might be the lower right corner of the sameillustration. See FIG. 3 in this regard.

In accordance with the invention, the number of transition images IT1 toITn will be sufficient to allow playback with a timing such that anordinary observer will not perceive the transitioning between thetransition images. Yet, the display of the images will progress overthat time period for image I1 to image I2.

This is illustrated somewhat in FIG. 2 where a series of imagestransition between a capital letter “A” in 10 point font to a capitalletter “A” in 36 point font. The images are as follows:

Image Point Size I1 10 IT1 11 IT2 12 IT3 14 IT4 16 IT5 18 IT6 20 IT7 22IT8 24 IT9 26 IT10 28 IT11/12 36

Even at this level the differences between the images are noticeable.But, FIG. 2 is provided only to illustrate how an image series mightprogress along a transition path. The number of transition images willbe greater to effect a more gradual, imperceptible progression, becauseeach increase in size in the letter includes at least one 100 percentchange in the value of a pixel from full white to full black. Thus, forexample, images IT7 and IT8 are not immediately successive transitionimages, but rather selected images for the purposes of explanation.

In FIG. 3, it is illustrated how a series of images can effect atranslation across a larger image 30. By generating a suitable number oftransition images that are played back over a suitably long period oftime, the displayed images can “move” imperceptibly across the largerimage 30. Image I1 thus represents the starting point, while image I2represents the final point of translation.

A well know illustration of M. C. Escher is called “Day and Night.” Inthis illustration, one half comprises an illustration of a daytime scenewhile the other half comprises a night time scene. There is a surrealvisual transition between the two halves such that birds flying in onedirection in one half appear to fly in the opposite direction in theother half. Such an illustration would be very appropriate for a visualtranslation thereacross using the present inventive technique.

The concept of translation may be particularly useful when translatingabout a 360 degree panoramic view. There are currently available anumber of such panoramic images on the World Wide Web that are playedback using Apple Computer's QuickTime™ movie player or MicrosoftCorporation's Media Player™ multimedia player. Such images could be usedas an input into a system processing images in accordance with theinvention to produce a very slow panning about the image.

Again, in such translations or pans, each 1 pixel translation wouldrepresent the beginning and ending of a “sub” transition path, as each 1pixel translation can represent a

100 percent change across the full range (e.g., 0-255) of pixel values.Upon playback of all of the “sub” transition paths, one would thetranslate across or pan the entire image.

It should be appreciated that the transition path need not represent atranslation across a large image but also can provide for transitioningwithin a portion of a large image or scene. As an example, a backgroundscene can be made to transitioning in an imperceptible manner while aportion of a scene provides for perceived actions. The active portioncan be superimposed or be simply portions of a series of images orframes that have perceptible transitioning (e.g., a fast moving boat).

In FIG. 4 there is illustrated a picture 40 with three objects which canbe defined as such via a suitable programming language so that they canbe separately manipulated. The illustrated objects are a beach 42, abody of water 44 and a ship 46. In accordance with the invention, theobjects 42, 44 and 46 can be interrelated to define a first image fordisplay. Then, in accordance with the parameters defined above, theobjects can be manipulated to produce transition images. For example,the location of the ship 46 relative to the other two objects 42 and 44can be adjusted to cause the ship 46 to move across the body of water44. However, in accordance with the principles discussed herein, suchrelative movement would take place over a sufficiently long period oftime so that no movement would be perceptible to the ordinary viewer. Ofcourse, a viewer who views the display at widely disparate points intime will notice the change in position of the ship 46. However, onewatching the display throughout the progression will not notice themovement.

Again, given a digital image, each translation of an object of 1 pixelwould represent the beginning and ending of a transition path. Uponplayback of a given set of transition paths, the objects will be able tomove relative to one another. Further, by superimposing and combiningtransition paths, or at least predetermined concurrent scene changesduring the generation of the transition paths, other effects can beimplemented, such as a simultaneous change in time of day, weather, etc.

The types of scenes that can be so manipulated are innumerable. Asanother example, a scene of a bay or port could be manipulated totransition between low and high tide and back again.

As can be appreciated, the exact configuration of a system and/orsoftware application for generating such transition paths is open to thewhims of the software programmer. Generally, however, it is believedthat the systems and/or software applications will follow the methodsset forth herein.

In FIG. 5, there is illustrated in schematic form a system forgenerating transition images. Via an appropriate interface 50, on ormore images are input into a computer 52 for generation of thetransition images. The computer typically will be a general purposecomputer programmed with application software employing the conceptsdiscussed herein. However, the nature of the makeup of such a computer,including its internal storage capacity, runtime memory, etc., will inpart be dictated by the size and number of images being generated.Further the exact image characteristics being evaluated and changedshould have some impact on that determination.

The manner in which an image is input can also be any of a variety ofinputs. Interface 50 is representative of input mechanisms such asscanners, film scanners, cameras, video feeds, digital image feeds, diskplayers, etc. The computer 52 is appropriately programmed or includesthe necessary software applications to extract an image from suchsources in the widely know ways.

After or while the transition images are being generated, they are theneither sent to a suitable storage device 54 or broadcast via terminal56.

Suitable storage devices includes, but are not limited to solid statememory such as RAM or programmable ROM, optical recording devices (CD,laser disks, DVD), magneto-optical disks, memory modules (e.g., compactflash memories, Sony Corporation's Memory Stick TM, etc.), magneticrecording devices, etc. The broadcast terminal 56 is representative of amyriad of broadcast or communications channels including cellularsystems, cable systems, telephone systems, wireless systems such asknown 900 MHZ systems, BLUETOOTH™ systems, networking systems, infraredsystems, etc. In short, the broadcast terminal 56 represents all knowncommunications systems and channels for transmitting a signal containingimage information.

It should be noted that the implementation of the present invention isparticularly suited for low bandwidth situations. Because high refreshrates are not of concern, images can be generated at a slow pace andtransmitted at slow speeds. The transmission needs typically wouldappear to be just the opposite of most other current applications seentoday where ever increasing transmission bandwidth is demanded toaccommodate changing graphics and other high amounts of information. Ofcourse, higher bandwidth might be required for large format images.

In FIG. 6 there is illustrated an example of a large displayincorporating principles of the present invention. A display 60 isrepresentative of a large screen used in large advertising signs, suchas large road side displays. Associated with display 60 is a computer 62with sufficient memory to accommodate storage of a desired transitionpath. For example, the transition path could be a scene that progressesfrom daytime to nighttime (and back again when played in reverse). Thecomputer would be programmed to playback the transition path using anyof the known playback software applications or players suitable for thefile format of the transition path. For example, the file format couldbe the AVI format. An AVI (Audio Video Interleaved) file is a sound andmotion picture file that conforms to Microsoft Corporation's WINDOWS™Resource Interchange File Format (RIFF) specification. AVI files (whichend with an .avi extension). Many suitable players are available fordownload over the World Wide Web and some are even provide as originalequipment on computer systems.

As illustrated, the computer 62 may also be programmed and equipped toreceive broadcast signals via a suitable feed 64. The feed 64 can be atelephone line or suitable wireless feed, such as a satellite pickup.With this enhancement, new transition paths can be downloaded to thecomputer in order to effect a change in the display (i.e., to change themessage or advertisement) or to enable real time playback of a remotelygenerated transition images.

The advantages of such a display system include at the very least,signnage that can evolve over time, but which does not create adistraction for passing motorists.

In FIG. 7 there is illustrated another display 70 which serves as thebackground screen behind a speaker 72, for example someone giving apresentation on a dais. Projecting images onto the background screen isa suitable LCD projector 72. The projector 72 is couple to a computer 74with a DVD drive 76. As can be appreciated, over a reasonable timeframe, for example, one hour, the computer 74 and projector 72 can beused to project a transition path formed in accordance with theprinciples set forth herein in order to display a background thatevolves imperceptibly during that time period. As an example, over thetime period a motivational message or logo can be made to appear.

In FIG. 8 there is illustrated a basic method for generating atransition path essentially as discussed above. In a step 80, a firstimage I1 is provided from whence the transition path will start. In astep 81, a second image I2 is provided. It is to this image that thetransition path will progress and end.

In a step 82 the images I1 and I2 are compared and differences noted inaccordance with the parameters the system will allow change. Preferably,as also discussed above, the changes will be noted as differences inpixel values. For example, in this step, all 3 channels (RGB) for allpixels in the images can be compared using the values of the subpixels.

If image I1 and I2 are the same in all respects, then the transitionpath is complete and the method is stopped by proceeding to step 87.However, if a difference still exists between images I1 and I2, then, instep 84, a transition image IT is generated as a progression from thecurrent image designated I1 toward image I2. For example, IT can be anincrement/decrement of a given value (e.g., 10) from a given subpixel ofII toward I2. Of course, as noted above, the image IT will be generatedas an imperceptible step toward image I2 within the thresholds definedabove. The progression is also kept to within the limits set by imageI2, i.e., the idea is not to generate an image that progresses beyondthe changes required to reach image I2.

Thereafter, in step 85, the just generated image IT is stored as thenext image in the transition path being generated. Alternatively, oreven simultaneously, if a broadcasting of the images is desired, then instep 85, the just generated image IT can be broadcast. In any event, formost, if not all systems, the image IT will be stored somewhere at leasttemporarily.

Further, as noted above, if the difference increments implemented aresufficiently small, e.g., 5 percent differences are being implemented,it is possible to store the images in a slightly different order thanthat in which they were generated. The reason is that the difference inorder will be imperceptible, by definition.

Thereafter, in a step 86, image I1 is set as image IT so that for thenext comparison with image I2, I1 represents a closer progression towardimage I2 thereby to advance the generation of the transition path.

It is recognized that instead of undertaking the foregoing steps, onemight generate all of the necessary transition images at once beundertaking an evaluation as to the number of transitions images neededto progress in defined steps from the first image to the second image.In such a case, repeated comparisons would not be necessary. However,such a system would not necessarily work well in situations wheretransition images are generated in real time or “on the fly” andbroadcast as they are being generated, i.e., in systems where thetransition images are not stored.

FIG. 9 illustrates a variation of the foregoing method but in which notcomparison is made between a first image and a second image. Rather, asillustrated, a first image I1 is provided and the system then generatesa transition path away from the first image. This might be useful insituations where only a change such as color is being effected.

As illustrated, in such a method, in a first step 90, the initial imageI1 is provided by some suitable means. Then in a step 91, a transitionimage IT is generated as an imperceptible progression away from imageI1. For example, a color component can be caused to change by 20 percentor less. Again, the amount of progression away can be random, orpredetermined.

In a following step 92, the just generated transition image IT is storedas the next image in the transition path. Of course, as in the methodpreviously described, instead of or in addition to storing a series ofimages, the image can be broadcast.

In a following step 93, a decision is made as to whether the transitionpath generation is complete. Suitable criteria might be length of thetransition path, an on/off switch input, etc.

If the transition path determination is not complete, then the processis repeated to generate a new transition image. For that purpose, theimage I1 is set to the most recent image IT so that the method willadvance along the transition path.

It should be noted that in this method, the progression away from thefirst image can be orderly or random. For example, if the first image I1is an abstract painting, it may well be that random imperceptiblechanges can be made. The transition path then would be a randomprogression imagery.

In FIG. 9 there is illustrated at least one medical application in avision or neurological field for the present invention. In theillustrated application, a transition path is displayed on a suitabledisplay 100 to produce an image 102 that evolves over time. In theillustrated case the letter “A” has finally developed to be perceptibleon the display 100. A subject 104 undergoing testing can be monitoredvia a suitable system, such as the eye reflex sensor comprising a camera108 coupled to a controller/processor unit 106. In such application, thesubject 104 is evaluated to understand the subject's reactions to imagesor portions thereof as they appear on the display 100. Due to the slowprogression in image changes in accordance with the invention, it ispossible to minimize some distracting influences on the subject, such asother motion on the display, etc. It may be possible to better isolateresponses to specific visual stimuli.

Another application for the invention is in the generation and playbackof images as background in a business presentation or in an advertisingpresentation. Using the invention, roadside signs could be made so as tochange imperceptibly so as not to be distractive to

drivers, yet to enable the advertiser to have a changing sign. In thisway, for example, an advertisement could appear different at night thanduring the day.

With respect to business presentations or the like, a background scenecould evolve over a presentation in a way so as not to be distractive,yet to still provide an impact on an audience. An example in thatregard, would be the eventual display of a logo or motivational message.

Yet another application for the invention is in the area of LCD lightvalves. The light valves could be programmed to change imperceptibly soas to provide a gradual change in the way light is allowed to passtherethrough. For example, a house with LCD screens covering a largewindow, could have the LCD screen display a transition path that effectsa gradual shading of the window, and vice versa. Further, a clear patchor opaque patch can be formed so as to slowly track across a largerwindow, thereby allowing/blocking a light source such as the sun.

Yet a further application of the invention is in the presentation ofimages generated for artistic reasons. A display, such as a plasmascreen, or a flat panel screen, could be used to display a new type oftransition path as a new art form.

It can be appreciated that the foregoing methods and systems should notbe limited to single or serial processing. Indeed, it would be very easyto also produce transition images in parallel using parallel processingtechniques. In this instance, each processor would be programmed orcontrolled to generate a given transition image along a transition path,for example, a given percentage change from the first image. This mayenable faster generation of multiple copies of a given transition path.

Again, the end result in most cases is the generation of a transitionpath that is played back much like a movie. Thus, the file format of theimages can be of any suitable format such as MPEG, MPEG2, MPEG3, AVI,JPEG, TIFF, bitmap, etc. The types of formats are well known to those inthe image processing fields. The only requirement is that the displaycontroller be capable of reading such files by including, or beingcoupled to, a processor equipped to run a suitable software applicationor plug-in useful for the selected multimedia file format(s).

In connection with the foregoing, it is noted that such file or motionpicture formats require the display of a certain number of images persecond. In normal NTSC television format, the images are played back ata rate of 30 images per second, i.e., a frame rate of 30 frames persecond. PAL television format uses a 25 frames per second display rate.Given that rate, and a calculated minimal display time of 5 seconds forimperceptible transition, 150 copies of a given transition image must beplayed back or displayed in seriatim in order to implement theprinciples discussed herein using current motion picture formats.

Given the foregoing, to implement the invention using current storagemedia such as DVD disks, one must store about 150 copies of eachdifferent image so that upon playback, each different image will displayfor at least 5 seconds. Thus, with reference to FIG. 8, for example, inthe step 85, some 150 copies of an image are stored as the next image ina series of stored images. Of course, in a broadcast situation, where itis possible to simply continuously broadcast an image for at least 5seconds, then only one copy at a time may need be produced.

It should be noted that it is possible for a display system to have avariable playback frame rate. In such cases, it may be desirable togenerate the transition images taking into account various playbackframe rates. In doing so, at least in one scenario, one would take intoaccount the fastest desired playback frame rate, the slowest desiredplayback frame rate, any frame rates therebetween, and any predeterminedplayback frame rate change sequence (or code) so that portions of thetransitioning would be tailored to the different playback frame rates.This could be useful, for example, to accommodate variable data transferrates or attaching significance to the variability in the playback framerate so that in effect an encoding is provided. The variable playbackframe rate provides for a decoding of the transition path. Then, onlythose with knowledge of the variability in the playback frame rate(i.e., those with knowledge of the playback frame rate change sequenceor code), can correctly playback the transition path to view theintended result.

Given the foregoing, the use of a predetermined rate of transitionbetween images (i.e., a predetermined frame rate) in the generation oftransition images means using either a single static frame rate or avariety of frame rates (i.e., a variable frame rate). This is theintended meaning of the phrase “predetermined rate of transition betweenimages” in the accompanying claims.

In FIG. 11, there is illustrated in schematic form displays fordisplaying images generated in accordance with the present invention. InFIG. 11 there is illustrated a display device 100 representative of amyriad of display devices including television devices and monitordevices (i.e., displays without television tuners). Item 102 representseither a tuner for a television device, or an image generator for amonitor device. Item 104 represents a myriad of video signal generatingdevices such as cable television boxes, DVD players, magnetic tapeplayers, external tuners, personal computer video cards, and the like,which are capable of generating signals compatible with the item 102,and transmitting the signals to the device 102 via a suitable mediumsuch as a cable or via wireless technology. Signals may also be receivedby appropriately configure devices 104 via a terminal 108. Item 104 mayalso represent an antenna configuration for a tuner 102.

The idea is that the actual device 100 may or may not physically includeall of the necessary components to play back the transition pathsgenerated in accordance with the invention. Further, the specificconfigurations are easily envisioned and assembled by those of ordinaryskill, depending on the needs for a given display device, and the extentto which a manufacturer decides to incorporate features into a displaydevice.

For example, there currently are on the market at least three liquidcrystal display still image display devices for displaying still imageson a table top, much like an electronic picture frame. One such deviceis made available by Ceiva Logic. Another is available from SonyCorporation. Yet a third is available from Weave Innovations. The firstand third devices are configured to receive signals via a connection tothe World Wide Web, and to display a series of still images. The SonyCorporation device displays images stored on its own memory modulebearing the mark “Memory Stick.” However, using the present invention,such devices could display a transition path configured to imperceptiblytransition from a first image to a second image by receiving imagesbroadcast over the Internet network system.

To accomplish the foregoing, all that is needed is a server configuredto display the transition path with such a timing that the differentimages are displayed in series for at least 5 seconds each. Thetransition path, of course, could be configured to last any duration,depending on the starting and ending images desired, as discussed above.

It can also be appreciated that most storage and broadcast media ofconcern will allow for concurrent storage or broadcast of audio signalsso that upon playback, music or voice or the like can accompany thevisual display.

While the invention has been discussed in terms of digital images, itcan be appreciated that it is equally applicable to analog formats suchas video frames. The image processing could involve digitizing theanalog signal and then processing the digitized signal as describedabove, or using spectral analysis or waveform analysis and manipulationtechniques. The resultant transition path might even be stored on amagnetic video tape, film or other suitable media as a movie. Themethods for generating the images would be similar, however, therecording format may be different. Further, the manner in which thechanges would be effected are the same as one would effect changes incurrent video or still image manipulation techniques. A major differenceis that the changes would be made on an imperceptible level, and, inmost cases, require a processor programmed to calculate and implementthe changes.

The invention also has application in laser displays. In laser displays,a laser is caused to move rapidly over a surface thereby drawing animage on the surface. Because the laser can be caused to redraw theimage at frame rates approaching or exceeding 30 frames per second, andbecause of the latent light retention of the human eye, to the humaneye, the whole image is perceived rather than a single dot or point oflight. In any event, the laser controller is feed an image pattern inorder to direct the laser or lasers to draw the image, typically on theside of a building. In accordance with the invention the image patterncan be a series of images defining a transition path in which any giventransition image is imperceptibly different from an immediatelypreceding different image.

Also, the invention has applicability in the area of holographicdisplays.

Holography is a technique for recording, and later reconstructing, theamplitude and phase distributions of a wave disturbance. It is widelyused as a method of three-dimensional optical image formation, and alsowith acoustical and radio waves. In optical image formation, thetechnique is accomplished by recording on a photographic plate thepattern of interference between coherent light reflected from an objectof interest, and light that comes directly from the same source or isreflected from a mirror.

A hologram is a special photographic plate or film used in holography.When this negative is developed and illuminated from behind by acoherent gas-laser beam, it produces a three-dimensional image in space.Sometimes it is known as a hologram interferometer.

A multiplex hologram is the holographic storage of photographicinformation. In a first stage a series of photographs or a certainamount of motion picture footage of the subject is exposed. The numberof stills or frames taken depends on how much of an angle of view isdesired of the subject in the finished hologram. For example if a 360degree view of the subject is desired, one might expose 3 frames perdegree of movement around the subject (usually the camera remainsstationary and subject rotates). This will result in the exposure of1080 frames. After the film is developed, a series of “slit” hologramsare made using a laser and using each frame of film as a subject foreach slit of holographic film. The slits are usually about onemillimeter wide and are packed so closely that there is no “dead space”in between. Also the hologram is bleached so that the strips disappear.

Usually a multiplex hologram yields horizontal not vertical parallax.This is because the camera usually is moved around the subject (or thesubject moves around in front of the camera) and doesn't usually passover the subject. Also, psychologically, horizontal parallax is muchmore desirable and the lack of horizontal parallax, to humans, is muchmore noticeable than the lack of vertical parallax. The multiplexhologram is usually, though not always, made on flexible film coatedwith the same holographic emulsion as photographic hologram plates.

The procedure can be totally mechanized so that a machine can expose aslit hologram per each frame of footage at a very rapid pace. Theadvantage of this type of hologram is that one can now have a hologramof almost anything captured on ordinary film without the need of a pulseruby laser. The disadvantage is that it is not truly a hologram butphotographic information holographically stored.

Nonetheless, using the principles of the present invention, a transitionpath of photographic images, can be formed and then used in generating aseries of multiplex holograms that transition imperceptibly from thefirst image of the series to the last image of the series. In thismanner, by way of example only, a three-dimensional image can be causedto rotate very slowly or to evolve very slowly. For example, a flowercan be displayed so as to slowly bloom.

Although modifications and changes may be suggested by those skilled inthe art, it is the intention of the inventors to embody within thepatent warranted hereon all changes and modifications as reasonably andproperly come within the scope of their contribution to the art.

What is claimed is:
 1. A method comprising the steps of: providing anelectronic representation of a first image to be displayed on at least aportion of a display; using a predetermined rate of transition betweenimages, processing at least said first image and generating a series ofelectronic representations of corresponding transition images defining atransition path which transitions away from said first image, saidtransition path comprising corresponding transition images any given oneof which is imperceptibly different from an immediately preceding imagealong the transition path such that upon successive display of saidtransition images at said predetermined rate of transition betweenimages or slower, an ordinary human observer will not perceive anydifference in said displayed images in said at least a portion of adisplay over at least about a 5 second interval; making each subsequentdifferent image in said transition path different from a prior image byan image difference determined prior to generation of the subsequentimage; and storing said electronic representations of said transitionimages defining said transition path.
 2. The method of claim 1, whereinany given transition image is different from its immediately precedingimage along the transition path by a predetermined difference.
 3. Themethod of claim 1, wherein any given transition image is different itsimmediately preceding different image along the path by a randomdifference.
 4. The method of claim 1, comprising the step ofbroadcasting each electronic representation of a transition image. 5.The method of claim 1, comprising the step of broadcasting eachelectronic representation of a transition image after it is generated,but before a subsequent electronic representation of a subsequenttransition is generated.
 6. The method comprising the steps of: using apredetermined rate of transition between images, generating a series ofelectronic representations of transition images along a transition pathin which each subsequent image is imperceptibly different from animmediately preceding different image such that upon successive displayof said transition images at said predetermined rate of transitionbetween images or slower, an ordinary human observer will not perceiveany difference in the displayed images over any given 5 second interval,at least over a portion of a display; making each subsequent differentimage in said series different from an image by an image differencedetermined prior to generation of the subsequent image; and storing saidelectronic presentations of said images.
 7. The method of claim 6,wherein any given transition image is different from its immediatelypreceding image along the transition path by a predetermined difference.8. The method of claim 6, wherein any given transition image isdifferent its immediately preceding different image along the path by arandom difference.
 9. The method of claim 6, comprising the step ofbroadcasting each electronic representation of a transition image. 10.The method of claim 9, comprising the step of broadcasting eachelectronic representation of a transition image after it is generated,but before a subsequent electronic representation of a subsequenttransition is generated.
 11. A method comprising the steps of: receivinga series of electronic representations of different images to bedisplayed on at least a portion of a display and defining a transitionpath in which each image thereof is imperceptibly different from animmediately preceding image, each subsequent different image in saidtransition path being different from a prior image by an imagedifference determined prior to generation of the subsequent image;displaying said different images in seriatim with a timing such that atransition between said corresponding portions of said images isimperceptible to an ordinary human observer over at least a 5 secondinterval.
 12. The method of claim 11, wherein said electronicrepresentations of said images are stored such that a plurality ofcopies of a given image are displayed in seriatim to effect such timing.13. The method of claim 11, wherein said images are displayed on a flatscreen display.
 14. The method of claim 11, wherein said images aredisplayed on a cathode ray tube display.
 15. The method of claim 11,wherein said images are display in a holographic imaging system.
 16. Themethod of claim 11, wherein said images are displayed on a screen usingan image projection device.
 17. The method of claim 11, wherein saidelectronic representations of said images are received via a recordingmedium and comprising the step of reading said electronicrepresentations of said images from said recording medium.
 18. Themethod of claim 11, wherein said electronic representations of saidimages are received via a communication channel.
 19. The method of claim18, wherein each of said images is displayed as it is received via saidcommunications channel.
 20. The method of claim 18, wherein saidelectronic representations of said images defining said transition pathare received via said communication channel and then said images aredisplayed in seriatim.
 21. A method of displaying a series of images ona display screen, comprising the steps of: providing a series ofelectronic representations of images to be displayed on at least aportion of a display and defining a transition path in which any givenimage is imperceptibly different from an immediately preceding differentimage, each subsequent different image in said transition path beingdifferent from a prior image by an image difference determined prior togeneration of the subsequent image; displaying said images in seriatimand with a timing such that transitioning between said images withinsaid at least a portion of a display and along said transition path isimperceptible to an ordinary human observer within at least a fivesecond interval.
 22. The method of claim 21 wherein said series ofelectronic representations of said images are generated one by one inreal time.
 23. The method of claim 21 wherein said series of electronicrepresentations of said images are provided in a storage medium.
 24. Themethod of claim 23 wherein said storage medium is a digital video disk.25. The method of claim 23 wherein said storage medium is a magneticstorage medium.
 26. The method of claim 23 wherein said electronicrepresentations of said images are stored in a digital format.
 27. Themethod of claim 23 wherein said electronic representations of saidimages are stored in an analog format.